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Field t>£ the Invention 

This Invention relates to a mechanism for preloading 
caches. The invention is applicable to, but not limited 
Lo, preloading of caches using knowledge or prediction of 
the cache user' 3 behaviour. 

Background of fcho Invention 

Present day communication systems, both wireless and 
wire-line, have a requirement to transfer data between 
communication units. Data, in this context, includes 
many forms of communication such as speech, video, 
signalling/ WEB pages, etc. Such data communication 
needs to be effectively and efficiently provided for, in 
order to optimise use of limited communication resources. 

In the field of this invention it is known that an 
excessive amount o£ data traffic routed over a core 
portion of a data network may iead to a data overload in 
the network. This may lead to an undesirable, excessive 
consumption of the communication resource, for example 
bandwidth in a wireless network, To avoid such overload 
problems,, many caching techniques have been introduced to 
manage the data traffic on a time basis. 

It is known that caching techniques have been used for 
many other reasons, for example, to reduce access time, 
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to make data readily available if there is a potential 
that a communications network may go down. 

An example of a cache, which may be considered as a local 
storage element in a distributed communication or 
computing system, includes network file systems. m the 
context of network file systems, data is retrieved from a 
file storage system (e.g. a disk) and can bs stored in a 
cache on the computer that is requesting the data. 

A further example of cache usage is a database system, 
where data records retrieved from a host machine are 
stored in a local machine's cache. As such, many 
computer systems keep a local copy (or cache) of machine- 
readable information, the master copy of which is stored 
on a host system. 

FIG. 1 illustrates a known data communication system 100 
that employs the use of a cache 110 to store data < 
locally, a local information processing device 135, such 
as a personal computer, a personal digital assistant or 
wireless access protocol (WAP) enabled cellular phone, 
includes a communication portion lib, operably coupled to 
the cache 110. The device 135 also includes application 
software 105 that cooperates with the cache 110 to enable 
the device 135 to run application software using data 
stored 5 iln'j or' accessible by, the cache 110. A primary 
use of the cache 110 is effectively as a localised data 
store for the local information-processing device 135. 



StNI BY: QPTIMUS_PATENTS; , +44.1258 818242; 14-AU^ 21:30; 



10 



IS 



PAGE B 



19003/PS-3/GB/Cassia 



- 3 - 



The communication portion 115 is used to connect the 
cache to remote information system 140, accessible over a 
communication network 155. In this regard, as well as 
for many other applications, caches are often used to 
reduce the amount of data that is transferred over the 
communication network 155. The amount of data transfer 
is reduced if the data can be stored in the cache 110. 
This arrangement avoids the need for data to.be 
transferred to the local information-processing device 
135, from a data store 130 in a remote information system 
140, over the communication network 155 each time a 
software application is run. 

£*urthermore, in general, caches provide a consequent 
benefit to system performance, as if the data needed by 
the local information-processing device 135 is already in 
the cache 110 then the cached data can be processed 
immediately. This provides a significant time saving 
when compared to transferring large amounts of data over 
20 the communication network 155. In addition, caches 

improve the communication network's reliability, because 
if the communication network fails then: 

(i) The data in the cache 110 is still available, 
allowing the local information-processing device 135 to 

25 continue its functions, to the extent possible given the 
extent of the data in the cache 110; and 

(ii) The application in the local information- 
processing device 105 can create new items or modify 
existing items in the cache, which can then be used to 
update the remote information system 140 when the 
communications network is restored. 



30 
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Caches are also known to have a self -managing capacity 
function, ao that once the cache approaches being full it 
discards some of the data that it is holding. A number 
of algorithms exist for this function.- a common one is to 
delete the data that was least recently accessed, in 
this manner, necessary (and frequently accessed data) is 
not deleted. Furthermore, the amount of unnecessary 
information maintained in Lhe cache is minimised. In 
this context, unnecessary information may be viewed as 
information that is rarely, if ever, requested by the 



user. 



It is also important that relevant information is 
15 downloaded to the cache. Downloading unnecessary 
information reduces the effective use of the 
communications channel between the cache and the original 
data source. Not only does this incur unnecessary 
communication costs, it utilises the data retrieval 
resource in both the host and cache. 



Most caches are not filled with information until the 
user requests it, at which point a copy of the 
information is retrieved and saved in the cache. The 
Information is often stored in the cache in case the user 
should need the same information again. An example of 
this type of cache operation is a browser that requests 
web pages from a remote web server. Once the web page is 
retrieved, it is stored on the local machine. If the 
user re-requests the page then (provided it is still 
valid) the web browser displays the cached version of the 
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page, rather than retrieving it once more from the remote 
web server. 

However, this approach to caching suffers from the 
drawback that it is only after the user has requested the 
information that it is retrieved and saved in the cache, 
in this regard, if the purpose of the particular caching 
operation is to speed up information access, then the 
first access will still be slow. Alternatively, if the 
purpose of the particular caching operation is to make 
the information available when the original data store is 
not accessible, then it. is only data that has already 
been downloaded that is available in the cache. 

Hence, it is known that some caches are *preloaded' with 
data so that the data is already available if the user 
needs it. Two examples of cache preloading are: 

<i) Disk file systems, where files of information 
are stored on a disk in a series of blocks, each block 
holding only part of a file's Information. Many disk 
file systems assume that users will request an entire 
file and so retrieve and store all the blocks that 
comprise the file into the cache before they are 
25 specifically requested by the file retrieval management 
system. 

(ii) Furthermore, Web servers are known to cache 
identified web pages in network servers closer to a 
30 recognised requesting party, in this manner, data is 

preloaded onto a cache in a machine that is closer to the 
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user than the original source of the data, no reduce an 
amount of conununi cat ions traffic in the data transfer as 
well as speeding up access to the cached data. The 
organisation responsible for the Web servers often 
downloads a page or set of pages to load onto the caching 
'servers' based, for example, on the frequency that pages 
are requested from that server. 

However, the inventors of the present invention have 
recognised inefficiencies and limitations in the 
operation and use of such preloaded caches. In 
particular, the methods are not suitable in the case 
where an individual user requests the information across 
a communications network that has costs or other 
limitations associated with using that resource. 

In a first example, a lot of unnecessary information 
(i.e. information that is never requested by a user) may 
be preloaded onto the cache. If the communications 
system between the data store and cache has performance 
limitations or is costly to use, then the user may also 
incur unnecessary costs or suffer unnecessary performance 
degradation whilst loading unnecessary data into the 
cache. 

In the second example, the system relies on a statistical 
prediction of the pages that will be requested by many 
hundreds or even thousands of users. In this case, it is 
cost effective to load many pages on the server, as the 
gains from having some of the pages read many times over 
outweighs the losses of having some pages that are hardly 
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read at all. If being accessed by a single user then 
these systems are no longer effective, as they are not 
able to predict with any certainty what information a 
single user might request in the future. 

5 

Within unrelated fields, such as wireless cellular 
communications, user-behaviour based concepts are known. 
One example is where a functionality of a mobile cellular 
phone is modified based on user-profiles (user 

10 behaviour) . In this regard, a user may be provided with 
preferred hand-over options, or enhanced handset 
features, based on these user profiles, say when entering 
a particular location, or following an estimated travel 
itinerary. These profile-based features are always 

15 downloaded and stored in a ^memory element' of the mobile 
cellular phone, a substantial amount of time before they 
are used. Notably, such approaches are not only 
unrelated to cache functions as herein described, but are 
focused on the operational capabilities of the device, Lo 

20 effectively re-configure mobile cellular phone's 
operation. 

Thus, there exists a need to provide an improved 
mechanism for preloading data objects to a cache, wherein 
25 the aforementioned problems are substantially alleviated. 



Statement of Invention 



In accordance with a first aspect of the present 
invention, there is provided a method of preloading data 
on a cache in a local machine, as claimed in Claim 1. 
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In accordance with a second aspect of the present 
. invention, there is provided a cache, as claimed in Claim 
28. 

In accordance with a third aspect of the present 
invention, there is provided a local machine, as claimed 
in Claim 29. 

In accordance with a fourth aspect of the present 
invention, there is provided a local machine, as claimed 
in Claim 30. 

In accordance with a fifth aspect of the present 
invention, there is provided a host machine, as claimed 
in Claim 32. 

In accordance with a sixth aspect of the present 
invention, there is provided a host machine, as claimed 
in Claim 33. 

In accordance with a seventh aspect of the present 
invention, there is provided a communication system, as 
claimed in Claim 34. 

In accordance with an eighth aspect of the present 
invention, there is provided a storage medium, as claimed 
in Claim 35* 



Further aspects of the present invention are as claimed 
in the dependent Claims. 



Best Available Copy 
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The preferred embodiments of the present invention 
provide a mechanism for preloading data on a cache based 
on a determined user behaviour profile / such that the 
. 5 data is made available to the cache user when the user 
desires. 

In this manner, data within the cache is maintained in a 
substantially optimal state, and configured to be 

10 available to a cache user when it is predicted that the 
user wishes to access the data. Thus, selected items of 
data are cached for predicLed retrieval by a cache user 
on an predicted demand basis, to avoid the cache memory 
problems and delays in downloading or preloading data to 

15 caches in known cache operations. 

Brief Description of the Drawings 

FIG- 1 illustrates a known data communication system, 
20 whereby data is transferred from a host machine to a 
cache residing in a local machine. 

Exemplary embodiments of the present invention will now 
be described, with reference to the accompanying 
25 drawings r in which: 

FIG. 2 illustrates a functional block diagram of a data 
communication system, whereby data is transferred from a 
host machine and preloaded on. a cache in a local machine, 
30 in accordance with a preferred embodiment of the present 
invention; 
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FIG. 3 illustrates a preferred timing arrangement for 
effecting the preload operation, in accordance with the 
preferred embodiment of the present invention; and 

FIG. 4 is a flowchart illustrating a method of 
preloading, in accordance with the preferred embodiment 
of the present invention* 

Description o£ Preferred Embodiments 

The inventive concepts of the present invention detail, 
at least, a general approach and a number of specific 
techniques for efficiently preloading caches with data. 
In the context of the present invention, the term "user" 
means either a human user or a computer system, and the 
term "data" refers to any machine -readable information, 
including computer programs. Furthermore, in the context 
of the present invention, the term "local" as applied to 
data transferred to a local cache or local machine, 
refers to any element that is closer to the user than the 
original source of the data. 

Referring next to FIG. 2, a functional block diagram 200 
of a data communication system is illustrated, in 
accordance with a preferred embodiment of the present 
invention. Data is transferred between a remote 
information system (or machine) 24 0 and a local machine 
235, via a communication network 155. An application 105 
runs on the local machine 235 and uses, data from a data 
store 130 located on the host machine 24 0. The local 
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machine 235 and the host machine 240 are connected 
through one or more communication networks 155 through 
respective (transceiver) communications units 115, 120 
located in each machine, as known in the art. The local 
machine 235 has a cache 210 that stores selected local 
copies of data that resides in the data store 130 in the 
host machine 240* 

The preferred embodiment of the present invention is 
described with reference to a wireless communication 
network, for example one where personal digital 
assistants (PDAs) communicate over a GPRS wireless 
network to an information database. However, it is 
within the contemplation . of the invention that the 
inventive concepts described herein can be applied to any 
data communication network - wireless or wireline* 

Notably, in accordance with the preferred embodiment of 
the present invention, a local preload function 255 has 
been incorporated into the local machine 235, and 
operably coupled to both the cache 210 and the 
application 105. Furthermore, a host preload function 
265 has been preferably incorporated into the host 
machine 240, and operably coupled to both the data store 
130 and the host transceiver communication unit 120. 
Generally, in the preferred embodiment/ one or both of 
the preload functions 255, 265 use information (user 
profile or user behaviour) that they know or can deduce 
about a user of the cache (210) /local machine (235) to 
predict what data the user is likely to need. 
Furthermore, the preload functions 255, 2S5 preferably 
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determine at What time the user is likely to need the 
data. In. this regard, one or both of the respective 
preload functions 25 5 , 265 is/are configured to ensure 
that the cache 210 has the requisite data, predicted to 
5 be required by the cache user, when the user so desires 
it. 
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Thus, the intelligence to initiate a preload operation is 
located at the host machine, at the local machine, or at 

10 both. Generally, it is advantageous to have the preload 
intelligence on the machine that has most knowledge of 
the user's behaviour, i.e. the local machine 235 of FIG. 
2» However, if both machines have knowledge of the 
user's behaviour then it is envisaged that beneficially 

15 the machines synchronise their user profile knowledge to 
build up the best picture possible of the user 1 © need for 
selected data items. the machines may also schedule 
preload operations as appropriate. 

20 In a first enhanced embodiment of the present invention, 
a mechanism to enable the respective preload functions 
255, 265 decide what data is to be preloaded to the cache 
210 is described. It is envisaged that many pieces of 
knowledge about a user may be used to predict what data 

25 to preload into the cache. 21Q. Table 1 provides a non- 
exhaustive set of examples. 
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Table 1 : 



Knowledge 
Item type 


j Example of Use 


Meeting 
schedule / 
diary 


If a sales meeting is to be held at a certain^ 
date and time, preload all relevant data for 
that meeting (customer na*ie, address, maps of 
the location, prior business details, etr ) 


Tasks 


If a user must carry out a specific task at 
a set time (e.g. stock check) then preload 
existing stock details and the stock 
checking application. 


Personal 
Interests 


I If a user has an interest 1n a sports team, 
stock market investment, industry sector, 
etc., then preload news Items related to 
that interest so the user can view then at 
his/her leisure. 


Routine 
behaviour 


If a user is determined as exhibiting a 
predictable behaviour, q.g. every Friday he 
downloads the latest sales forecasts to 
prepare a report, preload the sales forecast 
at an appropriate time each Friday. 


Predictable 
behaviour 


If the user carries out a set of linked 
tasks, such as filling in a parcel delivery 
multi-page report form that uses drop-down 
boxes , schedule a preload of the drop-down 
box contents for all pages as soon as the 
user enters the first page. 


Foreseeable 
behaviour 


If the user carries out task-based 
activities (such as a field service engineer 
repairing domestic appliances) then, if the 
engineer has a job to repair a washing 
machine, preload the parts list for that 
washing machine so the list is available 
when the engineer needs to record which 
parts were replaced. 
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Those skilled in the art will realise that known 
heuristic and artificial intelligence techniques can also 
be used to predict the user's future behaviour based, for 
example, on previous behaviour, and preload data into the 
cache based on these predictions. Such techniques are 
known to be complex, and are not described further here. 

A preferred example application of the inventive concepts 
of the present invention is in a wireless domain. 
Wireless communication systems, where a communication 
link is dependent upon the surrounding (free space) 
propagation conditions, the proximity of suitable 
transmitter/receiver sites and the availability of tree 
bandwidth on the link, are known to be unreliable. 
Hence, the inventors of the present invention have 
recognised the need to carefully control the data types, 
the amount of data and the timing of cache preloading 
operations in such situations. $uch preloading processes 
need to ensure the preloading process is complete in 
advance of the data being accessed, in case the local 
machine 235 were to become disconnected from the 
communication network for any length of time (for example 
if it is a wireless device and moves into an area with no 
radio coverage) . 

Therefore, in a second enhanced embodiment of the present 
invention, a mechanism to enable the respective preload 
functions 255, 265 decide when data is to be preloaded to 
the cache 210 is described. 



30 
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Once one. of the respective preload functions 255, 2 65 of 
FIG* 2 decides that a user may need a specific data item, 
for example a data item in Table 1, and then it must 
decide when to load it into the cache 210. 

The inventors of the present invention have both 
recognised and appreciated the criticality of the timing 
of preload operations. For example, data should not be 
loaded a substantial time before it is (predicted to be) 
needed by the cache user. In this context, the user's 
profile may change in the interim period between the 
cache being preloaded and the cache user needing the 
information. Thus, the user may no longer, need the 
cached data. Alternatively, if the data is preloaded 
from the host machine 240, the data may have been updated 
in the host machine 240 during this interim period. 
Thus, the updated data will also need to be preloaded 
into the cache 210. 

If the data is preloaded particularly early, or if the 
cache dynamics are rapidly changing to optimise its use 
in accordance with the preferred embodiment of the 
present invention, the cache 210 will subsequently 
receive other data items. Hence, a previously preloaded 
data item may be discarded before the cache user has read 
it. In a similar manner,, the data item may cause the 
cache 210 to be filled, thereby initiating other 'to-be- 
read' items to be discarded. 

Similarly, the inventors have appreciated that the data 
must not be preloaded too close to the time it is 



SENT BY: OPTIMUS.PATEMTS; ^ +44 125e fi1824a . 14 . AUt ^ 21 :33 . 



f 



10 



15 



25 



PAGE IS 



19003/FS-3/GB/Caasia 

- 16 - 

(predicted to be) needed by the cache user. m this 
regard, it is important to predict, with as much accuracy 
as possible, when the cache user will need the data. 
Factors that are preferably considered by the respective 
preload functions 255, 265 when predicting the time for 
preloading includes whether the communications network 
155 is, or is lifc ei y to-be,- unreliable or busy, m this 
case, the respective preload functions 255, 265 should 
factor into the download time the fact that the 
comnmnicationa network 155 may not be available when a 
preload is ideally performed. Furthermore, consideration 
that the communications network 155 may net be available 
again until after the time the data is required by the 
using application 10b needs to be made. 



In a typical data communication environment, such as a 
packet data wireless network, the time allotted for a 
preloading operation will depend upon a number of 
factors, for example including, but not limited to, any 
20 of the following: 

(i) The available bandwidth of the communication 
network, 

(ii) The loading on the communication channel, 

(iii) The size of the block of data to be 
transmitted to the cache, and 

Uv> An amount of processing required to retrieve 
the data identified from the data store 130. 



30 



Hence, referring now to FIG. 3, a preferred preload 
timing scheme 300 is described. Before beginning the 
process, a number of timing parameters are determined, 



tPg^20 ; ^^AWr02^9i3-2^ 
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based on the factors r for example preload time, network 
availability, etc., that are known to affect the. preload 
operation, a first timing calculation performed by the 
preload functions 255, 265 is a determination of a 
5 Minimum Message Delivery Guarantee Time Titimdg 330. A 

second timing calculation performed is a determination of 
the Maximum Preload Lead Time Tmpl 350. 

Tmmdg 330 is. a margin selected to allow for the case when 
10 the communications network 155 may not be available when 
the preload begins, for example due to wireless coverage, 
congestion, failure or any other reason. 

It is envisaged that Tmmdg 330 will be the same for all 
15 knowledge item types • Howe vex, this need not be the case 
if a priority rating is also applied to particular data 
items/ dependent upon, say the time of day. One example 
of this would follow from determining that news items are 
of particular importance to the cache user first thing' on 
20 a morning. In this regard, a higher priority rating, and 
therefore a larger Tmmdg 330 margin, will ensure that 
current news items are preloaded into the cache at the 
beginning of a working day. In this manner, the user 
habits for news items have been appreciated by the 
25 preload functions 255, 265, and a determination has been 
•made that news items are more important to the user at 
the beginning of the day, rather than at the end. 

The Tmpl timing parameter 350 is. a timing parameter 
30 determined by the preload functions 255, 265 as the 

maximum duration, before a predicted event <Te> 310, when 
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the preload operation can be started . The Tmpl timing 
parameter 350 is selected to prevent unnecessary 
information being preloaded if the event was to 
subsequently change* Preferably, the Tmpl timing 
parameter 350 is configured to be different for each 
knowledge item type* 

It is envisaged that the valuea of these timing 
parameters 330, 350 1 as well as a safety margin timing 
parameter Ts 320 described later, can be selected based 
on theoretical studies of the network behaviour. Such 
studies may result from simulating or otherwise modelling 
the network behaviour, by monitoring the network 
behaviour over time and/or estimating the timing values 
or by trial and error in each particular implementation . 
It. is also envisaged that the timing parameters 320, 3*30, 
350 may be fixed once set, or can be dynamically or 
continuously updated in response to changes in the c^che 
or local machine operational environment. 

A preferred method for achieving a dynamic or continuous 
updating of the timing parameters 330, 350 is to first 
initialise Tramdg 330 and Tmpl 350 with two threshold 
values. The threshold values are selected using the 
approaches described above and effectively set upper and 
lower targets (thresholds) for both the cache hit rate 
(i.e. the probability that the data required is in the 
cache 210 when needed) and the preload success rate (i.e. 
a probability that preloaded data is used). 
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The cache hit rate is then measured over time. If the 
hit rate is higher than the selected upper threshold then 
the value of Tmmdg 330 is reduced so that the success 
rate falls. If the success rate is lower than the lower 
5 threshold (which must be less than or equal to the upper 
threshold) the value of Tmmdg 330 is increased by a 
suitable increment. When the success rate lies between 
the two thresholds the local machine 235 may be assumed 
to be receiving cache data in an efficient manndx. 

10 

In this regard, data packet 360 is shown as being 
transmitted at the latest time period 380 when the 
communication network conditions are ideal , and at etn 
earlier time period 370 when the communication network 
15 conditions are, or are likely to be unreliable. 



Additionally, the preload, success rate is measured over 
time. If the preload success rate is higher than the 
upper threshold then Tmpl 350 is increased so that the 

20. success rate falls. If the success rate is lower than 
the lower threshold (which must be less than or equal to 
the upper threshold) , Tmpl 350 is reduced by a suitable 
increment* When the preload success rate lies between 
the two thresholds the selection of data items and the 

25 timing o£ preload operations is being performed in an 
acceptable manner * 

In the basic embodiment of the present invention, all 
preload types are given the same initial Ts 320, Tmmdg 
30 330 f and Tmpl 350 values/ which are subsequently adjusted 
if the preload Lime or operating conditions change. In 
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an enhanced embodiment of the present Invention, each 
type of preload operation (scheduled event, foreseeable 
event, etc.) can be provided with a different initial, 
and/or subsequently adjusted, Ts 320, Tmmdg 330 and Tmpl 
5 350 value. 



in accordance with a yet further enhanced embodiment of 
the present invention, it is envisaged that events within 
the same knowledge type can be grouped into categories. 
10 For example, two or more categories may be distinguished 
within, say, a routine behaviour knowledge item type. 
Such categories could be, for example, those items whose 
uncertainty in the predicted time for being accessed by 
the cache user varies by less than thirty minutes and 
15 those whose uncertainty in the predicted time varies by 
more than thirty minutes. In this scenario, each 
category is provided with its own initial and 
subsequently adjusted Tmmdg 330 and Tmpl 350 timing 
parameter values. In a similar manner, instead of the 
20 categories being selected based on predicted time, the 
categories may be selected based on a priority rating 
applied to the respective knowledge items within the 
behaviour type. 

25 Furthermore, for some knowledge types there may be 

uncertainty in the time at which data items are predicted 
to be required by the user. To improve the assurance of 
providing preloaded cache data to the user when he/she 
wishes it, a safety margin 'Ts' 320 is preferably 

30 introduced. The value of Ts will depend on the 

confidence in the prediction of the time the data item is 
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needed: if the confidence is low, Ts will be set to a 
high value? if it is high than Ts will be set to a small 
value. Ts may be chosen and subsequently adjusted using 
the same techniques as apply to Tmmdg and Tmpl described 
5 previously. 



Referring now to PIG. 4, a flowchart 400 illustrates the 
preload operation of the preferred and a number of the 
enhanced embodiments of the present invention. The first 
10 task in the preferred process of preloading data to the 
cache is to obtain a value for Te 310, the predicted time 
of the event at which the preloaded data will be used, as 
shown instep 405. A number of example mechanisms for 
determining a timing of a predicted event are described 
.15 above in Table 2. Such determinations can be made for a 
variety of knowledge items. 

Tn accordance With an enhanced embodiment of the present 
invention, the inventors have appreciated that the 
20 prediction of an event time for a number of knowledge 
items will include an element of uncertainty. For 
example, knowledge items from the routine behaviour, 
predictable behaviour and foreseeable behaviour items in 
Table 1 may not be accessed at the seme time of day by 
25 the user. For these types, a prediction of the 

uncertainty of these times is made, and an adaptation of 
the safety margin, Ts, is calculated in step 410. An 
ideal Ts 320 margin is calculated such that the preload 
functions ensure that the preload operation occurs early 
30 enough to take into account such unpredictability. 
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Table 2 shows preferred mechanisms for determining how Te 
and/or Ts can be calculated, for different knowledge item 
types. 



Table 2 - Calculating Te and T 9 for different knowledge 
item typos 



Knowledge 
item Type 


C*lcxil*tina Te 


Calculating Ta 


schedule/ 
diary 


Specified as part of the item 
(e.g. meeting time). 


2ero 

* 


Tasks 


Either specified as part of 
the task {e.g. due d*=ite) or 
through observing previous 
behaviour and predicting the 
LTpetic jLon pa tern ■ 


1* Set manually; 
2, Monitor prior 
occurrences and 
make prediction 
based on history 


Routine 
behaviour 


Through observing previous 
behaviour and predicting the 
repetition pattern . 


1. Set manually; 

2. Monitor prior 
occurrences and 
make prediction 
based on history 


Predict- 
able 

behaviour 


Triggered by another event 
{e.g. download a list of 
items required to populate 
the next page in a series of 
pages to be filled in by the 
user) . 


1. Set manually; 

2. Monitor prior 
occurrences and 
make prediction 
based on history 


Foresee- 
able 

behaviour 


Triggered by another event, 
likely with less Certainty 
and an additional delay than 
predictable behaviour (e.g. a 
service person may not need a 
parts list until recording a 
job as being completed) . 


1- Set manually ; 
2. Monitor prior 
occurrences and 
Xnak© prediction 
based on history 
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In order to] perform the desired timing calculations, the 
respective prelpad function obtains a current time value, 
in step 425 ♦ 

Clearly, if it is predicted that the user wishes to view 
the knowledge item imminently, an immediate preload is 
required! as shown in step time . 430. In this regard, a 
value for Tmmdg is calculated, in step 415, as described 
above- Following the calculation of Tmmdg, a 
determination is preferably made as to whether the 
predicted timing of the event is within the minimum time 
period calculated for the safety time Ts added to the 
communication delay time Tmmdg. If it is, and the local 
preload function is initiating the preload operation, a 
determination is made as to whether the cache is full, in 
step 455* If the cache is not full, the preload 
operation commences in step 465 1 If the cache is full, 
or sufficiently full that the data to be preloaded into 
the cache will cause the cache to be full, the preload 
function initiates a discarding operation of the data 
within the cache, as in step 460. This discarding 
operation may.be performed using any of the known 
techniques. After cache space has been made available, 
the preload operation may then commence, as shown in step 
465. 

A value for Tmpl is calculated, in step 420 f as described 
above. If the determination in step 430 is that there is 
available time before the preload operation needs to 
start, i.e. the time of the event is further away than 
the minimum time period calculated for the safety time Ts 



SENT BY: 0PTIMUS_PATENT6; +44 125B S18242; 14-AU^P 21 :35; PAGE 27 



19003/FS-3/GB/Cassia 

- 24 - 

and communication delay time Tmmdg f then a determination 
is made as to whether the time is close enough to the 
predicted time of the event to make it worthwhile 
beginning the preload operation, as shown in step 435* 
5 The determination in step 4 35 is preferably made in 

consideration of the fact that the event may be changed 
or deleted. Such a consideration may make the preload 
• operation unnecessary. 

10 The algorithm cycles through step 425, step 430 and step 
435 until the preload operation is allowed, i*e« the 
predicted time to the event is determined as being within 
an acceptable window 340, at step 435. It is noteworthy 
that, in general, there will be a reasonable time window 

15 between the preload being allowed following step 435 and 
the preload being mandatory following step 430- 

Once the preload function has determined the time to the 
predicted event is inside this window, a determination is 

20 made as to whether the cache has available capacity for 

receiving the preload data, in step 440. If there is not 
sufficient capacity within the cache in step 440 , then 
the preload operation is delayed until there is 
sufficient capacity, by repeating steps 430, 435 and 440. 

25 This cycling operation only repeats until the minimum 
time period is reached in step 430* 

The preferred mechanism for determining the fullness of 
the cache in step 440 is as follows. The rate of cache 
30 re-loads is measured, i.e. the frequency at which items 
that have been dropped from the cache 210 in FIG. 2 are 
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subsequently reloaded. This measurement operation is 
performed over a suitable averaging period, likely to be 
a duration equal to several multiples of the average life 
of items in the cache 210. if the cache re-load rate is 
very low, for example less than a threshold of say 5%, 
then the cache 210 is deemed as being rarely full and is 
therefore available to be preloaded immediately. If the 
cache re-load rate is higher than this threshold, then 
the cache 210 is deemed too small for the data it is 
typically being asked to hold. In this case, preloading 
the data should be delayed as long as possible so as not 
to force other data items in the cache 210 to be 
discarded before the data has been used. 

If a determination is made in step 440 that the cache has 
sufficient space to accept the preload data, then a 
determination is preferably made in step 445 as to 
whether the current time is the most economical time to 
preload the data. Advantageously, this, provides the 

local machine with the opportunity to minimise costs by 
ensuring the preload operations are performed at a time 
that may incur reduced communications costs. Preferably, 
in step 44 5, the algorithm calculates whether there will 
a time within the acceptable window, i.e. before 'Tnow- 
Te<Ts-Tmmdg' is reached, when the preload operation over 
the communication network 155 will be less expensive. If 
such a determination is made in step 445, the preload 
function waits to initiate the preload operation, in step 
465, until the less- expensive communication resource is 
available, by cycling through steps 430 to 445. 
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If, in step 445, a determination is made that it is an 
economical time to perform a preload operation, then a 
determination is preferably made as to whether the 
communications network 155 is busy in step 450, or at 
5 least that the network would not be overloaded by 

commencing the preload operation, it is envisaged that 
the preload function may. take any measure necessary to 
reduce overload, depending upon the priority or urgency 
of the preload, operation, such measures are described 
10 later. If the communication network is determined as not 
being busy in step 450, the preload operation is 
commenced in step 4 65. 



Those skilled in the art will immediately recognise that 
the respective steps can be effected in a variety of 
orders. Furthermore, several steps may be omitted or 
modified in their operation, depending on the importance 
of managing the size of the cache 210, the cost of the 
communication network 155 and the load on the 
20 communications network 155. Tn this regard, in some 
scenarios, it is within the contemplation of the 
invention that step 445 may be omitted, for example if 
there is no cost implication in using the communication 
resource at various times. Additionally, the local 
25 machine may be configured such that the cache is rarely, 
if ever, full. i n this scenario, the preferred algorithm 
may omit step 440. It is also envisaged that the 
determination in step 450 may be omitted, if the preload 
function is configured to force the preload operation 
ahead of other tasks being performed, for example if the 
preload operation was of a high (or highest) priority. 



30 



SENT BY: OPTIMUS_PATENTS; 




+44 125B S1B242; 



14-AUG-, 



1 :3G; 



PAGE 30 



19003/F5-3/GB/Cassia 



- 27 - 



10 



15 



20 



25 



In many communications networks the cost of a specific 
transmission varies, depending on factors such as: 



communication link/ for example their geographic location 
and/or the communication resources available at that 
location; or 

(iii) The structure of the data message to be 
transf erred r for example whether it is a single 
unf ragmentable large block of data or several smaller 
blocks . 

In the preferred embodiment of the present invention, the 
cost (charging) parameters of the communications network 
155 are defined within one or both of the preload 
functions 255 , 265, In this manner, the preload 
functions 255/ 265 are able to use these cost parameters 
to calculate the most cost effective time to preload 
particular items of data. For example, the preload 
functions 255, 265 may use the preferred algorithm of 
FIG. 4 to calculate that there is a wide-enough window 
during which a specific piece of data could be preloaded 
where the window extends over two (or more) of these cost 
parameters. In this regard, the preload function 255, 
265 in step 44 5 would select the most cost effective time 
during this window to initiate the preload operation. 

In a further enhanced embodiment of the present 
invention, it is envisaged that multiple communications 
networks connect the local machine 235 and the host 



(i) The day or time of day; 

(ii) The source and destination nodes of the 
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machine 240. Perhaps r as is often the case, some of the 
networks may only be available intermittently, for 
example due to time or location constraints. In this 
case, it is envisaged that in step 445 the preload 
5 functions can calculate the costs of the preload on each 
network within the allowed preload window and select the 
least expensive communication network to use, as well as 
performing the preload operation at the cheapest time. 



10 Optionally, rather than the parameters of the 

communications networks 155 being defined within the 
preload functions 255, 265, it is envisaged that the 
preloaded data or cost (charging) information may be 
obtained from a remote server that the preload functions 

15 are able to access. A first example is where the 

communications network cost parameters may be stored on a 
server within another network (for example, the 
Internet) . In this regard, the preload functions 255, 
265 use communication links to this network to download 

20 the parameters on a regular basis. Alternatively, the 
cost parameters may be downloaded automatically, or on 
command from the server when a change in the parameters 
had been notified or detected. 

25 It is envisaged that a second example would be where the 
communications network cost parameters could be stored in 
the data store 130, which could itself be updated using 
the method described above. The host preload function 
263 and/or the local preload function 255 could then 

30 access the cost parameters from the data store* 

Alternatively, the host preload function 265 could 
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download the parameters over the communications network 
155 and store them in the cache 210, in which case the 
local preload function 255 would appear to be just 



concerned. 

In addition, or in the alternative, a further reason for 
preloading a cache in accordance with the preferred 
embodiment of the present invention is to preload data 
''only' when network costs are inexpensive rather than 
loading the data at the point it is required but when the 
network costs are higher. In this regard, the cache 
preloading operation may be initiated based on the time 
or the location of the local machine 235. As an example, 
if either preload function 255, 265 predicted that during 

the morning peak time a user would require a certain 
piece of data, it could initiate a preload during the 
night, i.e. at an off-peak time. In this regard, the 
data would be preloaded purely because it can be 
preloaded at a minimum cost and would be available in the 
cache 210 the following morning when required. 

As a yet further optional improvement, one or both of the 
preload functions 255, 265 may be configured to assess 
how busy the communications network 155, local machine 
235 and/or the host machine 240 are. The one or both 
preload functions 255, 265 may also schedule preload 
operations for times that provide a more acceptable 
impact on the performance of their respective machines. 
Preferably, the scheduling includes one or both of the 
following methods: 



another using application as far as the cache 210 was 



SENT BV: .OPTIMUS.PATENTS; +44 125s 81624a . 14 -AUQ^21 :37; 



10 



20 



PAGE 33/49 



19003/PS-3/GB/Cassia 



- 30 - 



U) Scheduling the entire preload operation for 
periods when the communication networks is not busy; and 

Cii) Scheduling the preload operation to occur in 
blocks of time with intervals arranged between the blocks 
for other network users to use. in this manner, the 
preload operation avoids consuming a whole communication 
resource for a prolonged period but instead provides 
other network users access to the network while the 
preload operation fa j n progress. 



It is also within the contemplation of the invention that, 
data may be preloaded for events that have no pre- 
requisite time associated with them. One example would 
be for data that is personally interesting to the user 
15 audi as sports results. Even though the preload function 
is able to predict that the user will want to access the 
cached data, the preload function may not be able to 
predict when. For these knowledge items, it is 
preferable for the preload function to initiate the 
preload operation as soon as the data becomes available. 
The techniques described above, which may be used to 
delay the preload operation, can also be applied for 
events that have no pre-requisite time associated with 
them. However, this is at the risk of the data not being 
25 preloaded and immediately available when the user wants 
to use it. 



More generally, it is envisaged that the aforementioned 
preloading operations may be implemented in the 
30 respective host or local machines in any suitable manner. 
For example, new apparatus may be added to a conventional 
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conventional machine may be adapted, for example by 
reprogramming one 0£ more processors therein. As such, 
the required implementation (or adaptation of existing 
local or host machine Is)) may be implemented in the form 
of processor-implement able instruction^ stored on a 
storage medium, such as a floppy disk, hard disk, PROM, 
RAM or any combination of these or other storage 
multimedia. 

In the case of other network infrastructures, wireless or 
wireline, initiation of a preloading operation! may be 
performed at any appropriate node such as any other 
appropriate type of server, database, gateway, etc* 
Alternatively, it is envisaged that the aforementioned 
preloading operations may be carried out by various 
components distributed at different locations or entities 
within any suitable network or system. • 

It is further envisaged that the applications that use 
caches in the context hereinbefore described, will often 
be ones in which a human user requests information from 
the data store (or. serving application) 130- The 
application 105 will. then preferably provide the 
opportunity to select or influence preloading functions 
by the user. For example, a user may be provided with a 
series of questions to answer, in order to provide an 
initial user-behaviour characteristic. 

It will be understood that the data communication system 
described above, whereby a cache is preloaded with the 
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data the user needs, provide *t least the following 
advantages : 

(i) The selecLed user-specific data is made 
available notwithstanding whether, for any reason, the 
communications network fails {i.e. the reliability of the 
application in the local machine is much increased) ; 

<ii) The response to the user is shortened, as data 
that is more useful is locally stored in the cache. 
Therefore, the data does not need to be retrieved across 
the network; 

(iii) By careful selection of the time that the 
preloaded data is scheduled to be loaded into the local 
cache, communication costs may be minimised by 
configuring downloads when the network capacity is low 
and communication resource costs are inexpensive. 

(iv) the effects on the performance of the local 
machine, host machine and communications network are 
minimised. 

Whilst the specific and preferred implementations of the 
embodiments of the present invention are described above, 
it is clear that one skilled in the art could readily 
apply variations and modifications of such inventive 
concepts » 

Thus, an improved mechanism for preloading data objects 
to a cache has been described wherein the abovementioned 
disadvantages associated with prior art arrangements have 
been substantially alleviated. 



0^2 2 
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Claims 

1- A method (400) of preloading data on a each© 

(210) in a local machine (235) , wherein said cache is 
5 . operably coupled. to a data store (130) in a remote host 
machine (240), the method characterised by the steps of: 

determining a user behaviour profile for said 
local machine (235) ? 

retrieving data relating to said user behaviour 
10 profile from said data store (130) ; and 

preloading said retrieved data in said cache 
(210), such that said data is made available to a user of 
said cache when desired. 

15 2. The method {400) of preloading data on a cache 

(210) according to Claim 1, wherein said step of 
determining is performed by a preload function (255) in 
said local machine 235 operably . coupled to said cache 
and/or a preload function (265) in a remote host machine 

20 (240) operably coupled to said data store (130), 

3. The method (400) of preloading data on a cache 
(210) according to Claim 2, the method further 
characterised by the step of: 

25 predicting, by at least one preload function, a 

data type required by said cache user based on said 
determined user behaviour profile. 

4. The method (400) of preloading data on a cache 
30 (210) according to Claim. 3, the method further 

characterised by the step of: 

predicting (405) , by said at least one preload 
function, an event time for said data type to be required 
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by said user based on said determined user behaviour 
profile (210) . 

5. The method (400) of preloading data on a cache 

5 (210) according to Claim 3 or claim 4, wherein said step 
of predicting includes one or more of the following 
steps : 

predicting said event time based on said data - 

type; 

10 observing one or more previous user behaviour 

patterns; or 

predicting said event time following a trigger on 
another event. 

15 6. The method (400) of preloading data on a cache 

(210) according to Claim 3 or Claim 4 or Claim 5 r the 
method further characterised by the step of: 

predicting a preload time, by said at least one 
preload function (255, 265) based on said predicted data 

20 type . 

7. The method (400) of preloading data on a cache 

(210) according to Claim 6, wherein said predicted 
preload time is based on one or more of the following 
25 parameters: 

(i) An estimate of a cache re-load rate; 

(ii) An availability of a communications network 
resource (155) ; 

(iii) A previously achieved cache reload rate; 

(iv) ft cost parameter of one or more available 
communications network resources, for example a resource 
at a location and/or at a time; 
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8* The method (400) of preloading data on a cache 

(210) according to any preceding Claim, the method 
further characterised by the steps of; 

determining (425) a current time,- and 
5 calculating a subsequent event or preload time 

therefrom. 

9. The method (400) of preloading data on a cache 
(210) according to any of preceding Claims 6 to 8 f the 

10 method further characterised by the steps of: 

calculating a safety margin of time; and 
performing said preloading of said data to said 
cache (210) , at a time at or before said saftery margin 
prior to said predicted preload time such that said data 
IS is made available to said "cache user when desired. 

10. The method (400) of preloading data on a cache 
(210) according to Claim 9, wherein said step of 

calculating a safety margin includes the step of: 
20 predicting (410) an uncertainty of an event time, 

for example based on said data type and/or prevailing 
network conditions. 

11. The method (400) of preloading data on a cache 
25 (210) according to Claim 9 or Claim 10 r wherein said 

safety margin is either set. manually or is based on a 
monitoring of previous event occurrences. 
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12* The method (400) of preloading data on a cache 

30 (210) according to any preceding Claim, wherein said 
event includes one or more of the following: 

(i) A diarised ev^nt for said user; 

(ii) A task to be performed by said user; 
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(iii) A personal interest identified for said 



user; 



(iv) A routine behaviour pattern identified for 
said user; 

5 (v) A predictable behaviour pattern identified 

for said user; or 

(vi) A foreseeable behaviour pattern identified 
for said user. 

10 13, The method (400} of preloading data on a cache 

(210) according to any preceding Claim, wherein the 
method is further characterised by a step, prior to said 
step of preloading, of; 

determining and implementing a timing margin 

IS (Tmmdg) (330 > to allow for potential unavailability of 

said communications network (155) before commencing said 
step of preloading. 



14. The method (400) of preloading data on a cache 

(210) according to Claim 13 when dependent upon Claim 8, 
the method further characterised by the steps of: 

determining whether a predicted timing of an 
event is within a time period of less than or equal to 
the current time minus said safety margin and/or said 
25 Liming margin; and 

commencing (4S5) said step of preloading in 
response to a positive determination* 



15. The method (400) of preloading data on a cache 

(J? 10) according to Claim 14, the method further 
characterised by an intermediate step of; 

determining <455) whether said cache has capacity 
to store said data to be preloaded* 
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16- The method (400> of preloading data on a cache 

(210) according to any preceding Claim, wherein the 
method is further characterised by a step, prior to said 
5 step of preloading, of: 

determining (435) a preferred maximum time (Tmpl) 
(3i>0) before said predicted event timewhen said step of 
preloading can commence. 

10 17. The method (400) of preloading data on a cache 

(210) according to any preceding Claim/ the method 
further characterised by the step of: 

adapting one or more timing parameters (330, 350) 
continuously or dynamically in response to a change in 

15 the communication network or user behaviour profile. 

18. The method (400) of preloading data on a cache 

(210) according to Claim 17 f the method further 
characterised by the steps of: 
20 . applying One or more threshold values to said one 

or more timing parameters (330, 350) for: 

determining an acceptable cache hit rate, 

and/or 

determining a preload success rate, and 
25 adapting said one or more timing parameters (330 , 

350) in response to said determination (s) • 



19. The method (400) of preloading data on a cache 

(210) according to any preceding Claim, the method 
30 further characterised by the sLeps of: 

grouping data types into categories based on, for 
example, one or more of the following: said data types f a 
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priority of said data type, a predicted event time for 
said data to be preloaded/ and 

scheduling a preloading operation of data based 
on said grouping. 

20. The method (400) of preloading data on a cache 

(210) according to any preceding Claim, the method 
further characterised by the step of* 

determining (440) whether said cache has 
available capacity for receiving the preload data prior 
to commencing said step of preloading . 



PAGE 



21. The method (400) of preloading 'data on a cache 
(210) according to Claim 20, wherein the step of 

15 determining whether said cache has available capacity 
includes measuring a rate of cache re-loads* 

22. The method (400) of preloading data on a cache 
(210) according to any preceding Claim, the method 

20 further characterised by the step of; 

determining (445) whether the current time is an 
economical time to preload said data to said cache, and 
in response to a positive determination, preloading said 
data to said cache (210), 

25 

23. The method (400) of • preloading data on a cache 
(210) according to Claim 22 when dependent upon Claim 8, 
wherein the step of determining whether the current time 
is an economical time includes calculating whether a more 

30 economical time may be subsequently available within an 
acceptable preload window for said step of preloading. 
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24. 



The method (400) of preloading data on a cache 



10 



15 



20 



25 



(210) according to Claim 22 or Claim 23, the method 
further characterised by the step of: 



associated with one or more network resource (s) to said 
host machine (240) or said local machine (235) or a 
remote server accessible by said host machine (240) or 
said local machine (235) , such that said determination of 
whether said current time is an economical time to 
preload said data to said cache (210) can be made. 

25. The method (400) of preloading data on a cache 
(210) according to any preceding Claim, wherein said step 
of preloading includes: 

preloading said accessed data in said cache 
(210) , based on said user behaviour profile for said 
local machine <235), only when network costs are 
inexpensive, such that said data is made available to 
said cache user when desired at a substantially minimised 
cost . 

26. The method (400) of preloading data on a cache 
(210) according to any preceding Claim, the method 

further characterised by the step of; 

deterxaining (450) whether a communications 
network (155) to be used in said preloading step is busy 
or whether said communications network (155) would be 
overloaded when commencing the preload operation, and in 
response to a positive determination delaying said step 
of preloading said cache (210) . 



downloading one or more cost parameters 



27. The method (400) of preloading data on a cache 

(210) according to Claim 26, wherein, in response to 
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determining that the communications network (155) is busy 
or would he overloaded/ the method is further 
characterised by the steps of: 

scheduling an entire preload operation for 
5 periods when the communication network is not busy; or 

scheduling said step of preloading on a block-by- 
block basis that provides intervals between said blocks 
for other users to use said communications network (155). 

10 28. A cache (210) preloaded in accordance with any of 

Claims 1 to 27. 



29. A local machine (235) characterised by a cache 

preload function (255) operably coupled to a cache (210) 
15 that is preloaded in accordance with any of Claims 1 to 
27. 



30. A local machine (235) comprising: 

a local communication unit (115) for operably 
20 coupling said local machine to a host machine (240) via a 
communication network (155) ; and 

a cache (210) operably coupled to said local 
communication unit (115) ; 

the local machine (235) characterised by: 
25 a preload function (255) , operably coupled to 

said cache (210) , for determining a user behaviour 
profile for said local machine (235) and preloading data 
on said cache (210) based on said user behaviour profile, 
such that said data is made available to said cache user 
30 when desired* 

31. The local machine (235) according to Claim 2 9 or 
Claim 30, wherein said local machine (235) is a personal 
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digital assistant configured to communicate over, for 
example, a General packet radio network wireless network 
to a remote host machine (240) , 



a local communication unit (120) for operably 
coupling said host machine (240) to a local machine (235) 
via a communication network (155) ; and 

a data store (130), operably coupled to said 
local communication unit (120); 
the host machine (240) characterised by: 

a preload function (265), operably coupled to 
said data store (130), for determining a user behaviour 
profile for said local machine (235) and preloading data 
from said data store (130) to a cache (210) on said local 
machine (235) based on said user behaviour profile, such 
that said data is made available to a user of said cache 
when desired. 

33. A host machine (240) characterised by a data 
preload function (265) operably coupled to a data store 
(130), for performing the cache preload steps according 
to any of Claims 1 to 27. 

34. A communications system (200) adapted to support 
the method (400) of preloading data on a cache (210) in a 
local machine (235) according to any of preceding Claims 
1 to 27 or comprising a local machine (235) according to 
Claim 29, Claim 30 or Claim 31 or a host machine (240) 
according to Claim 32 or Claim 33. 



32. 



A host machine (240) comprising* 
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35- A storage medium storing processor-implemenLable 

instructions for controlling a processor to carry out the 
method of any of Claims 1 to 27. 



5 36. A local machine (235) substantially as 

hereinbefore described with reference to r and/or as 
illustrated by, FIG. 2 of the accompanying drawings. 



37* A host machine (240) substantially as 

10 hereinbefore described with reference to, and/or as 
illustrated by, FIG. 2 of the accompanying drawings . 

38. A preload function (255, 265) substantially as 
hereinbefore described with reference to r and/or as 

15 illustrated by, FIG. 2 of the accompanying drawings* 

39. A method (400) of preloading data on a cache 
(210) substantially as hereinbefore described with 
reference to, and/or as illustrated by, FIG. 4 of the 

20 accompanying drawings. 
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Abstract 

METHOD AND APPARATUS FOR PRELOADING CACHES 

A method (400) of preloading data on a cache (210) in a local 
machine (235) . The cache (210) is operably coupled to a data 
store (130), in a remote host machine (240). The method 
includes the steps of determining a user behaviour profile for 
the local machine (235) r retrieving data relating to the user 
behaviour profile from the data store (130) t and preloading 
the retrieved data in the cache (210) , such that the data is 
made available to the cache user when desired* 

A local machine, a host machine, a cache, a communication 
system and preloading functions are also described. 

•In this manner, data within the cache is maintained and 
replaced in a substantially optimal manner, and configured to 
be available to a cache user when it is predicted that the 
user wishes to access the data. Thus, cached data is stored 
for predicted retrieval by a cache user on an predicted demand 
basis in order to avoid the cache memory problems and delays 
in downloading or preloading data to caches in known cache- 
arrangements . 

{FIG 4 to accompany abstract) 
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FIG. 2 
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